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PURPOSE AND BACKGROUND 

Until the 1967-68 academic year, the primary interpretive materials 
for the Ciraduate Record ExBininations (GRE) were the scores for basic 
reference groi5>s of college seniors, ^o for the most, part took the tests 
in 19^2 (l)* At its meeting in 196U, the^ Committee on Testing of the 
Association of Graduate Schools recommended that new data — data represen- 
tative of the performance of enrolled first-year gradiiate students— be 
collected and published* This recommendation resulted, in the initiation 
of the current study*. The purpose of this atudy was to obtain data on 

A the performance of first^ear graduate students on the Jipt^tude Test and^ 

^^^^ J ^ 

the Advanced Tests of the Graduate Record Examixiations * ^ ^ 

Ttoday the primary interpretive data for CHIE te^sts are norms -^it 

National Program c^didates teste<5from May 196U through ^ril 1967 (l)* 

however, since not all National Program candidates Attend graduate school, 

the data on first-year graduate students described here shouM be of further 

use to^ graduate schools and fellowship sponsors in interpreting QRK scores* 
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POPUIATIOM AND SAMPI£ 

The population of the study consisted of those students i-rtio enrolled 
as full-time graduate students for the first time in the fall of I96U in 
a college or university belor/ging to the 228Hinember Council of Graduate 
Schools (cos)* Students from countries irtiere the primary language is not 
English and students who had physical liandicaps (guch as blindness) which 
might have affected their ORE scores were excluded tvdtn the population* 

Subpopulations were composed of students enrolled in graduate study 
in 19 irujo^r field categpries~l8 major fields^^fqr which ORE Advanced Itests 
vrere appropriate and a nineteenth categpry calleq '^dther*" 

The Advanced Tests for the I8 major fields Veye is follows: 

Biology .Engineering Literature in Physics 

Business French English ' Psychology 

Chanistry ^ Geology Mathematics Sociology 

Economics Government* . Riilosophy Spanish 

Education History Physical Education 

A two-stage sampling plan was used to select the saji^les for each of 

the various subpopulations* The first stage involved the selection of 

universities and Colleges from the CGS members* CGS member institutions 

were grouped into categories accordi^ to the number of graduate degrees 

awp.rded in I96I-62 as reported by the tJ*S* Office of Education (3)» The 

2 0 — 

. The name of this test will be changed to Political Science in the* 
fall of 1968. ^ 
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thirty institutions granting the most graduate degrees in 1961-62 were 
included in the sanple. Also included were 1^ institutions randomly 
Selected fi'om the 60 universities or colleges with the next highest 
number of conferred graduate degrees, and 1? randomly selected from the 
remaining institutions. A greater proportion of the large universities 
WHS included in the sanple, so that those fields in which only a small 
number of students were enrolled would be adequately represented. 

Of the 60 institutions in the sanple invited to participate in the 
study, 52 agreed to furnish rosters of students and 35 agreed to test 
each of those students who had not taken the Aptitude Test or an Advanced 
Test in his major field* Eight schools did not participate. (A list of 
the participating colleges and universities in each of the three size 
categories is given in Appendix A.) 

The second stage of sanpling involved the selection of students 
wi^thin each institution. Some of the participating institutions selected 
their own sanples following a plan' suggested by ETS (see the *'Plan of Data 
Collection'* in Appendix B), while other institutions sent rosters to ETS 
for sairpling. A spaced san^sle was chosen according to the ETS plan. The 
san$>ling ratios, which varied from field to field, were deslgned^o yield 
a minimum of 300 students in the group for each of the 19 major field 
classifications. Thus, smaller percentages of students were- sairpJLed from 
the more popular major fields. 

After the second stage of saiipling was finished^ the 1963 and 196U 
ETS files were searched to determine which of the students in the saiiyle 
had appropriate ORE scores. Each student who attended an institution 
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that agreed to conduct fecial testlnga was aaked to take the Aptitude 
Test If Aptitude scores were missing and the Advanced Test in his major 
field (provided his undergraduate and graduate major fields were the 
same) If the Advanced Test score was missing* The special testing^ ware 
conducted late in the first semester and early in the second semester of 
the 196U-65 academic year* 
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PERJORMAMCE OM THE GRE TESTS 



How well did the firat-year graduate students perform on the GftE 
tests? Score data for Verbal Ability, Quantitative Ability, and the 
Advanced Tests are given in Tables 1-3* These tables show the percent 
of graduate students scoring lower than selected scaled scores. It is 
jurportant to note that, because of missing scores, the Advanced Test 
distribution for a particular major field was not based on the same 
students as the Aptitude Itest distribution for that field* 

The data in Tables 1-3 are based on weighted frequency distribu- 
tions* Weighting was necessary to estimate the population frequency 
distributions from the sanple data* The weights were determined primarily 
from the number of full-time first-year graduate students reported by the 
U.S. Office of Education for each of the participating institutions (U). 

Ihe Score frequencies for a particular field and institution were 
adjusted for (a) the size of the Institution's class of full-time first- 
year graduate students, (b) the number of fuU-time firat-year graduate 
studehts^ln the size category (large, medium-sized, "small) in which the 
institution was classi/led, and (c) the number of CGS schools In that 
particular size category* (The actual formula used In coiiputlng the 
weights is given in Appendix C.) 

Since the. score dat^ for the fields of business, education, and 
physfcal education were probably biased (see next section), neither 
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Aptitude Test nor Advanced Tt->jt L^ooro f^-iAUi ar^ rvp^^v-J^ t^.r ^i;*':!'- 
Aptitude Test data for these fields 'rfi!r**, howtwf^r, ir:' Iud*^J t:: 
tributions for ''all fields/' It \fav, thought any bi/i':5 fty.^:-:: 

the data for the three fields woul/i ::ot ^uive a bia^^ir:*^ ^'Tfv^^ * 
overall Aptitude Test distributions. 
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ACCURACY OF THE DATA 



Hou accurate are the data reported Ip Tables 1-3? One way to 
answer t^i3 question is to determine confidence intervals /or the 
various means of the score distributions*. However, such a procedure 
can be used legitimately only if the sampljlng is random. Since there 
is reason to^ believe that the final sajrpies were random, this pro- 
cedure was not considered apfpropr4ite. Another way \to approach the 
question of acciiracy is to examine (a) the representativeness of the 
original aample and (b) the number of students in the original sair^Ie 
with appropriate ORE scores. 

The samples in three fields were considered tmrepresentative 
because there were insufficient numbers of students in the samples from 
particular graduate schools. Fbr exan^le, because of a communication 
problem, no students from the University of Michigan were represented 
in the sample fpr education, even though a lange number of first»-year 
graduate students were enrolled in this field at the University of 
Michigan in the fall of 196U. Thus, the sanple for education could 
not be considwed representative. The other fields which were judged 
to have biased data because pf Inadequate representation from some 

colleges or universities were business, .pliysical education, and '<other*\ 

/ 

The samples ii) some fields were^ also considere^d tmropresentative 
because of ambiguity in the definition of subpopulations. Since graduate 
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achool peraormel should be more able ^han^^^ el3,e to determine the 
subject-matlier areas for which a given Advanced Test is appropriate, the 
colleges arid universities that selected theiJ*' awn saiFpJLes were asked to 
define the subpopulatioRS for the various fields. Educational Ttesting 
Service defined the subpopulations when, it selected the sanples. (Subject- 
ma^tter areas included under a particular major field heading when ETS 
selected the sair5>les are indicated in Appendix D.) As a result, certain 
ambiguities arose. The fields most seriously affected were probably 
^ biology^ education, and "other". 

Even if sanples of students ar^ representative, the data might still 
be biased if appropriate test scores are not available for all of these 
students. In this study, not all of the students in the original sample 
had scores. Students at 17 institution* were not offered fecial testings, 
and only about 30^ of th^ stud<?nts asked to particjlpate in the special 
testings offered by the other 35 institutions actually were 1>ested» Ihe 
number and the percent of students in the ojfiginal sanple for this study 
who had Advanced T^st or Aptitude Test scores are reported in ^ble Ii. 
The percent of students who had appropriate test scores ranged from 9% 
tin business) to 66% (in physics) for the Advanced Tasts, and from 21% 
(in business) to 73% (in psychology) for the Aptitude Test. Because the 
percentages of students with CRE scores were so law, the Advanced Test 
distributions in*the fields of business, ^ucation/ and physical education 
and the Aptitude Tast distributions in the field of business were probably 
biased. 

Another way to approach the question of accuracy is to compare 
the distributions with data for other grox^s. TWc such groups are the 
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NUMBER AND tERCEMTAGE OF STUDENTS IN A PARTICULAR SAMPI£ 
WHD HAI) ADVANCED TEST OR APTITUDE TEST SCORES 



fi 

NiiiTiber 
In 



Students vlth 
Advanced Teat Scores 



Stiidenta with 



Major Field 




San^le 


Number 


% 


Number 


% 


Biology' 




2U3 


129 


53 


163 


- 67 


Busineaa ^ 
Chemiatry 




332 


■ 31 
268^' 


59 


. 69 
280 


21 
61 


Economics 






23U 


53 


260 


56 


Education 




3^3 


69 


20 


116 


33 


Engineering 




3U8 


159 


U6 


17? 


50 


French 
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.1^2 
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Ili6 


37 


Oeology 
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99 
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126 


6^ 


Oovemment 
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16U 
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Literature in 
' Engliah 




U69 ■ 


232 


U9 


237 


51 


Mathematica 




?06 


26? 


' 52 


289 


57 


Philoaophy 




U36 


188 


U3 


228 


52 


Phyalcal Education 




Hi? 


36 


2U 


5? 


37 


Phyalca ^ 




3U6 


227 


66 


233 


67 


Psychology 


3?? 


,222 


63 


2^8 


73 


Sociology 






187 


3U' 


2^1 




Spaniah 




V 2^1 


82 


33 


77 


31 


Other 




lOtOi 






378 


36 
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ORE baaic reference groa;5)3 of college seniors (l) and l963*'6h ORE National ^ 
Program Candidates (2). In general, the means for- the Tftptitude Test and 
the Advanced Tests from the current study were somewhat lai*gpr than those 
reported in the 1963-6U study and much larger than the means for the college 
seniors. The Verbal Ability and Quantitative Abild^ty means of first-year 
graduate students were approximately 1? points higher than the corresponding 
means of the 1963-6U National Program candidates. The Verbal Ability mean 
for first-year graduate students Was, on the average, 55 points higher than . 
the corresponding mean of college seniors, while the Quantitative Abilitl 
mean was abcmt 75 points higher'. The Advanced T^st scores of first-year ^ 
graduate students averaged about S^VoiJ^ts higher than the scores of 
National Program candidates and about 100 points hi^er than the scores of 
college seniors. However, the means for first-year graduate students were 
sli^tly Icjwer than -the means for National Program candidates in biology 
(Verbal Ability mean), government (Quantitative Ability mean) and mathe- 
matics (Advanced Test mean). 

A third corparison group is the l961i-67 norms group, who also 
were National Program candidates (se^ -tt ^e tfandbook for the Interpretation 
of GRE Scores^ 1967-^68 ). No data >y major field are available on the 
l961i'67 group for the Aptitude T^st. However, the overall Verbal Ability 
and Quantitative Ability means for f irst-year, graduate students ware 
approximately 2? points higher than the means for the 19614*67 norms group. 
The Advanced T^3t n^ans for first-year graduate students in all fields 
but mathematics were also hi^^ier than the means for the 1961i'-67 grceup^ 
In. mathematics the jnedn for the norms group slightly exceeded the mean, for 
first-year graduate students. In the other fields, the means of first-^ear 

ID 
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graduate students ranged from 23 points higher in biology to ^8 points 
higher in geolog^* 

Generally, these findings seem reasonable* Most of the persons 
who took the OBE tests ^n the National Program intended to go to gradu- 
ate school or in some cases were already enrolled. However, a number of 
these perMns were probably not admitted to CGS member schools^ and 
others failed to attend any gradioate school* Thus, one would e^ect 
the scores of the National Program candidates to be lower on the average 
than the scores of enrolled first-year graduate students. Likewise one 
would e^ect the scores of enrolled first-year graduate students to be 
substantially higher on the average than the scores of conplete classes 
of college seniors, not all of whom actually attend graduate school* 

That the means for first-year graduate students were lower than 
the means for National Program candidatds in biology and government on 
the Aptitude Test and in mathematics on the Advanced Tests is somewhat 
disturbing* It might be that the means for first-year graduate students 
in these fields ware low* However, a large percentage of ,the National 
Program candidates ware applicants for National Science Fb\indation (NSF) 
fellowships. Each applicant was required to take the Aptitude Test and 
an Advanced Test if one was offered in his field* Advanced Tests were 
offered in biology, che^nistry, economics, engineering, geology, govern- 
ment, mathematics, physics, psychology, and sociology. The percent of 
applicants for HSF fellowships in the 196U-67 norms group was particu- 
larly high in chemistry (26^), mathematics (2^50, physics (23^), and 
geology (20^), respectively* Thus, the Advanced Test means for these 
four fields especially and the Aptitude Test means for the 196U-67 norms 
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\ 

\ 

\ 

grotp were somewhat inflated. If one removed the effect associated with 
the percentage arid caliber of NSF felloHship applicants, the means for 
first-year graduate stur.enta would probably haye 'be^ consistently higher 
than the means for National Program candidates. 

. In sunnary, thenf^the Aptitude and Advanced Itest data for the 
fields of business, education, and physical education and the Aptitude 
Test data for "other*' fields were probably biased and are not reported. 
However, the data for the other fields appear ,to be reasonably' consistent 
with coii5)arative data from other sources, particularly when the percent- 
ages and caliber of NSF fellowship applicants are considered. The 
reported data are probably fairly accurate estimates of the performance 
of full-time first-year graduate students who attended colleges or uni- 
versities belonging to CGS in the fall of 196U. 
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^ Appejpdix A 

0OUEGE3 AND UNIVERSITIES WHICH PARTICIPATED IN THE 
(BE STUDT OF FIRST-TEAR dtADUATB STUDfMTS 



or Unlveraltleo 



Boston University 

California, Univaraity of 
(BerkelBy) 

California, Unlveraity of 
(Los AngalBs) 

Chicago, tftiiverslty of 

poJumbla University 

jUrvard Unlvorjlty 

niinoia, University of 

lom^, university of . 

Kassachusetts Institute of 
Tschnologjr 

Michigan Stats t^veraity ^ 

HLchigan, University of 

Klnnaaota, Qhlveralty of 

Missouri, Qhiversity of 

Nev York University 

Hdrtlwestam Uhivert*ity 

Ohio Stata University 

Psnna^lvanla Stata 
Ihii^rsity 

I^imB/lvanla , thiiversity of 

Purdus ttaiversity 

Stanford thii^roity 

Sjracuss Unlveirsity ^ 

Uashington, University of 

Wlsconain, t^rersity of 



HediuA-Sizod CoUegos 
or Universities 

Alabama, University of 

Arkansas, University of 

Cincinnati, UhfVersity of 

Colorado, Unlverai'V of 

Johns fispkins University 

Kent Stata Uaivaraity 

Miami University (Ohio) 

Nebraska, University of 

Oklahoma State University 

Qlkahona, thiiveraity of 

Princeton Unlveraity 

Southern Illinois 
University 

Astern Michigan 
University - 



'Small Colleges 
or Universities 



Akron, University of 

Atlanta University 

California Institute of 
Technology 

California, University of 
(Santa Barbara) 

Dartmouth College 

Duke University 

Jefferson Hedical College 
of PKHadelphia 

Louisville, University of 

Maine, University of 

Miami, university of 
(Florida) 

New Tortc, State Itaiveraity of 
(Albany) 

TUskegee Institute 

Utah State University 

Virginia Poljrtechnic Institute 

Washington State IMveraity 
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i^pendlx B 
PIAM OF DATA COLUCTIOM 

^- 

I> Identification of^ atudentg to be included^ln the gample 

. Jl^ Major fleldg to be sanpled * ^n the (VaSvate Record Examinatiojig 
Ilational Program for graduate School Selection* the Aptitxfcde Tegt 
^ and eighteen Advanced Tegtg are admlnigtered* It ig planned to 
obtain Advanced Tegt normg on firgt-year graduate gtudentg enrolled 
ija the corresponding niajor fieldg* Aptitude Tegt normg will be 
obtained on the bagig of a crogg gection of all firgt*year grad- 
uate gtudentg* In order to provide Aptitude Tegt normg it ig 
necegsary to obtain gcore data oh the Aptitude Teat for gtudentg 
enrolled in other fieldg ag well ag for gtudentg enrolled in the 
eighteen major fieldg* In addition* it ig planned to provide 
Aptitude Tegt normg on gtudentg enrolled in each major field* 
l^e major fieldg to be ganqpLsd are ligted in the table in Section 
I-C* . 

B* Sanpling ratiog for tiHfe major fieldg # The number of cageg . 
needed In the ganqple to repregent. the population of eacSi major 
field adequately ig approximately 30Q* Since more gtudentg 
are enrolLsd in gome fieldg than in otherg* it ig desirable 
to-uge different saii?)ling ratiog for the different major 
fieldg to obtain adequate gaiFpleg Tttas for a field with a 
large enrollment* such ag engineering* a smaller proportion 
of the total enrollment would need to be gelected than for a 
field with a analler enroUment* In the cage of a field with " 
a very aiiall Enrollment every gtudent may have to be gelected* y 
Tb adjugt for differences in enrollment in the major fieldg 
the ganqpling ratiog given in the table in Bection I-C have bem 
chogen* 

C* Procedure for ''the gelection of an unbiaged ganp le* It ig 
eggential that the sampling within each major field be ag 
nearly random ag pogsibiB in order not to biag the normg* 
The following procedures are deglgned to produce an unbiaged 
ganple* 

1* The popillation to be ganpled congigtg of all gtudentg 
entering graduate school in the fall of 196it* Since 
ganqpling ratios differ from field to field (see table 
on following page)* the total population of gtudents 
mugt be identified according to the eighteen major fieldg 
designated in the table* All of the nameg of the gtudentg 
In major fields not specifically degignated In the table 
ghould be ligted on ^ combined roster and identified by 
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major field. Although a single roster is to be used for 
major fields not listed in the table, the major field with 
which each student is affiliated should still be indicated. 

2. Within each of the^ eighteen fields named in the table and 
within the combined "category, each student should be assigned 
a number from 1 to N (where N equals the total number of stu- 
dents enrolled in the field or In the combined category)* 

3. In the actual selection of the students for a major field 
sample f the first student to be selected will be the one 
whose number corresponds to the Initial selection number 
given ixi the table. Then the following oases to be selected 
will be. determined by the sajnpling ratio for that major field. 
Of course in the case of a sarq^ling ratio of 1/ljt all cases 
would be included in the san^^le. Ftor exarple, if at institu- 
tion A there were 100 graduate students enrolled in the Hi3tory 
Department in the fall of 196U, these studen^ts would be lieted 
on a roster^ and assigned consecutive numbers. In accordance 
with the initial selection number in the table> the first stu- 
dent to be selected would be student No. 2; and in accordance 
with the sampling ratio for History (1/3), every third student 
thereafter, i.e., students numbered $y 8, 11, etc., would be 
selected \mtil the, entire list of students in the field was 
exhausted. 



Sanpling ■Ra.tios and Initial 
Selection Numbers for Major Fields 



Major 
Field 

Biology 

Business 

Chemistry 

Eoonomics 

Eciucation 

Engineering 

Rrench 

Geology 

Qovemment 

History 



Sair^pling Initial 
Ratio Selection No* 



1/5 

1/10 

1/3 
1/2 
1/10 
1/10 

1/1 
1/]- 

1/2 
1/3 



1 
1 
^2 
1 



1 

1 
2 



Major 
Field 

Literature ' 
Mathematics 
Philosophy 
Physical 

Education 
Physics 
Psychology 
Sociology 
Spanish 
M^jor Fields 
Not Listed 



Samlijig Initial 
Ratio Selection *lo, 



1/5 
1/3 
1/1 

1/2 
.1/3 
1/3 
1/1 

m 
ink 



1 

2 



1 
2 
2 
1 
1 



D. Preparation and mailing of the roaters . On the enclosed rostors 
the names of ths students selected ^or the samples should be listed 
according to major fiel<fs. If CUE scores are readily ftvailable on 
the students, they should be recorded in Columns, ii-6 on the rosters. 
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For a atudent who haa one or more itiiaaing GRE acoroa, the najne cf 
the undergraduate college he last attended ahould be given; and 
hi3 date of birth should bo provided if it is readily available* 
When the roatera are coriplot^d, they are to bo sent to: 



Dr- Philip R» Harvey 
Aaaiatant Program Director 
Graduate Record Exajninations 
Educational Iteating Service 
Princeton, New Jersey 



II , 5p<3cial test adminlgtr^tion for securing missing data on students in 
the sarpTe ' 

l^ie students in the Sajrtple for whom. CSiE acores are available vrlll not 
need to be tested* ETS will aearch the filea for the acorea of thoae 
studenta whoae acdrea are not funviahed by the cooperating institutions* 
Studenta for whom the Advanced Test score and/or the Aptitude Teat acores 
are aiaal^g will be requested to take the taat(s) for which acoras are 
not available* ETS will report to each cooperating inatitution the naries 
of students to be teated, and a teat date will be arranged for the inati- 
tution* Examination foaterials and inatructions' for testing will be pro- 
vided by ETS, 
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V^pendix C 

WEiaHTS*USED IN PREPARING THE FREQUEMCt DISTRIBUTIONS 

The weight for a college or imiversity i in a given Cield was 
computed as follows: ^ 

whe^'e - The number of fuli-tlne first year graduate students at 
college or uniTersit-y 1 In the saniple; 

Fj^ = the nujnber In the sair^ile who had the appropriate ORE score; 

N =» SN^ for all colleges or uniTersities in the sane size cattjgory 
as college or university i; ^ . 

N* = INi (Fi / 0) for all colleges or universitias in the same sise 
Cflttegory as college or uni'7e(rsity i> 

H = the weight based on the sar^ling ratio in the appropriate size 
category (l for large co]J.ege3 or uniyarsities^ h for medium- 
sized coUegea or uniTersitiee, and I38/15 for ^all colleges 
or uniTeraities) . 

To sae how this weighting scheme. worked^ considar tha following 

exajxtle for the field of Biology; 

College or 
University 



Size Category 


ID No. 


JL 


I 




Large 


1 


21 


0 




(R"i) 


3 


li8 


h 


15.5 




30 


2h 


2 


15.5 


Medium-Sized 


31 


21 


3 


28.0 


Cr-u) 


32 


0 


0 






li5 


^ 19 


1 


76.0 




li8 


18 


h 


lil.li 


CR-138/15) 


h9 


8 


6 


12.27 




■ 60 


9 


1 


■82.8 
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In this exappLe the weights for colleges or iinivorsitlee 3) 31j arid h9 in 
Biology were computed as followa: 

rJo. 3% b8 X 93 X 1 - 

No, 31: 21 X iiO X b - ?8.0 
3 Ho' 

No. ii9: 8 X 3? X 138 - 12.27 

For both the Aptitude Tdst and the Advanced T^sts^ the frequen- 
cio3 were weightod according tc the weights calcTiiated by tht^ fornula 
given previcrasLy, Hawover, for the Aptitude 'IN?5t froquencies wre combined 
across fields to give overall distributions lor Verbal Ability and Quanti- 
tative Ability as well. ^ distributions for each of t^e msjor z'ields. 
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Appendix D 

SPECIFIC FTEIi)S CLASSIJIED UNDER PARTICUIAR MAJOR FIELDS 

TOR SAMPUMG PURPOSES 



Biology: Biolofy, General 

Botany 
Zoology 

Business I AccoMiiting 

Business Administration 
Busiiiesd and Commerce 

Chemistry; Chonistry (including 
Analytical^ Inorganic^ 
Organic^ and Physical 
Chemistry) 

Economics : EconOnvics 

Education; Administration 
Counseling 

Qulilance 
Early ChUdhood 

Education 
Education^ General 
. Diucattonal P^chology 

Elementary Education 
. History and Philosophy 
of Education 
Secondary Education 

Engineering: Aeronautical 
Chemical 
Civil 

Electrical 

Ehgineeringj General 

Industrial 

Mechanical 

FVench 
Geology 



Government I 
History ; 

Literature : 

Mathematics i 

Philosophy I 

Physical 
Education: 

Phystcsi 
Psychology; 

Sociology: 
Spanish 1 



Oovemment 
Political Science 

American History 
European History 
History, General 

Conp^ative Literature 

Ehglish 

Literature 

Mathematics 
Statistics 

Philosophy 

Phyeical Education 

Chemical Physics 
Physics 

Psychology (inpluding 
Clinical Psychology and 
Social Psychology) 

Sociology 

Spanish 



Ft*enchi^ 
Geology i 



